Siamese infrared and visible light fusion network for RGB-T tracking

نویسندگان

چکیده

Due to the different photosensitive properties of infrared and visible light, light images have individual features. However, since registered RGB-T image pairs shot in same scene, they also contain common This paper proposes a Siamese fusion Network (SiamIVFN) for RBG-T image-based tracking. SiamIVFN contains two main subnetworks: complementary-feature-fusion network (CFFN) contribution-aggregation (CAN). CFFN utilizes two-stream multilayer convolutional structure that separately extracts features, filters each layer are partially coupled extract is feature-level network, which can cope with misalignment pairs. Through adaptively calculating contributions features obtained from CFFN, CAN makes tracker robust under various conditions. Experiments show compared state-of-the-art techniques, improves PR/SR score 1.5%/8.8% on RGBT234 2.1%/6.9% GTOT. The tracking speed 147.6FPS, current fastest tracker. source codes available at https://github.com/PengJingchao/SiamIVFN .

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hierarchical Siamese Network for Thermal Infrared Object Tracking

Most thermal infrared (TIR) tracking methods are discriminative, which treat the tracking problem as a classification task. However, the objective of the classifier (label prediction) is not coupled to the objective of the tracker (location estimation). The classification task focuses on the between-class difference of the arbitrary objects, while the tracking task mainly deals with the within-...

متن کامل

Fusion of Thermal Infrared and Visible Images Based on Multi-scale Transform and Sparse Representation

Due to the differences between the visible and thermal infrared images, combination of these two types of images is essential for better understanding the characteristics of targets and the environment. Thermal infrared images have most importance to distinguish targets from the background based on the radiation differences, which work well in all-weather and day/night conditions also in land s...

متن کامل

A Twofold Siamese Network for Real-Time Object Tracking

Observing that Semantic features learned in an image classification task and Appearance features learned in a similarity matching task complement each other, we build a twofold Siamese network, named SA-Siam, for real-time object tracking. SA-Siam is composed of a semantic branch and an appearance branch. Each branch is a similaritylearning Siamese network. An important design choice in SA-Siam...

متن کامل

Similarity Mapping with Enhanced Siamese Network for Multi-Object Tracking

Multi-object tracking has recently become an important area of computer vision, especially for Advanced Driver Assistance Systems (ADAS). Despite growing attention, achieving high performance tracking is still challenging, with state-of-theart systems resulting in high complexity with a large number of hyper parameters. In this paper, we focus on reducing overall system complexity and the numbe...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: International Journal of Machine Learning and Cybernetics

سال: 2023

ISSN: ['1868-8071', '1868-808X']

DOI: https://doi.org/10.1007/s13042-023-01833-6